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(57) ABSTRACT 

A method and apparatus for bit rate allocation, or statistical 
multiplexing, in a multi-channel video data encoder. A 
pre -processor in each channel determines a bit rate need 
prior to compression and encoding. A control processes the 
bit rate need in each channel to arrive at an allocated bit rate 
for each channel. The video data is then compressed and 
encoded according to the allocated bit rate. The bit rate 
demand accounts for various characteristics of the current 
picture data in each channel, including spatial activity, 
temporal activity, image size, frame rate, scene change, 
brightness, flash, fade, and horizontal pixel resolution. The 
system also biases the bit rate allocation according to 
inter-frame distance, whether the average spatial activity 
level is below a lower threshold, whether the inter-frame 
distance is above an upper threshold or below a lower 
threshold, whether the quantization of previous frames is 
above an upper threshold, the length of the Group of Pictures 
(GOP), and a user-selectable priority factor. The system also 
allocates any surplus bit rate among the channels to avoid 
having unused bandwidth. 

8 Claims, 7 Drawing Sheets 
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PRE-PROCESSING OF BIT RATE 
ALLOCATION IN A MULTI-CHANNEL 
VIDEO ENCODER 

BACKGROUND OF THE INVENTION 

The present invention relates to a method and apparatus 
for bit rate allocation in a multi-channel video data encoder. 
The invention relates generally to statistical multiplexing, 
wherein a bit rate (e.g., bandwidth) is allocated to the 
different channels based on the channels' bit rate needs and 
the overall available bandwidth. 10 

Statistical multiplexing is the process of encoding a 
number of signals at variable bit rates and combining the 
variable -rate bitstreams into a single fixed-rate transport 
stream so that the bandwidth allotted to each signal is 
flexible and varies with each signal's bit rate need. 15 
Conventionally, an estimate of bit rate need is made based 
on signal statistics. After a bit rate is allocated based on the 
need, the data in each signal is compressed and encoded 
using a specific quantization level. The amount of data that 
results from the compression is examined in each channel, 20 
and the quantization level is adjusted so that channels with 
more encoded data receive a higher bit rate. Next, the video 
data is compressed and encoded again using the adjusted 
quantization level. The process may be repeatedly succes- 
sively in multiple feedback cycles. Other conventional tech- ^ 
niques attempt to equalize a quantization distortion measure 
across the channels. 

However, the conventional techniques have various draw- 
backs. For example, the use of successive feedback cycles in 
the compressor can be time-consuming and computationally 3Q 
intensive. Additionally, special bit rate needs for specific 
types of video scenes may not be considered. Moreover, the 
equalization of a quantization distortion measure does not 
reliably translate to an equalization of perceived image 
quality. 35 

Accordingly, it would be desirable to provide a high- 
performance dynamic rate allocation system that quickly 
and accurately allocates bit rate to a plurality of video 
channels to equalize the overall image quality of all channels 
at any time instant. The system should provide a pre- d0 
processor which measures statistical information of the 
video data prior to compression and encoding to estimate the 
relative bit rate required to adequately encode each video 
scene. The measurements should be made sufficiently early 
in the encoding process to eliminate undesirable time delays. 45 
The system should provide the allocated bit rate to the video 
compressor from the pre-processor in a feedforward path to 
avoid undesirable feedback. The system should also provide 
the capability for feedback processing to fine tune the 
allocated bit rate before providing it to the compressor. 50 

Furthermore, the system should measure or detect at least 
some of the following characteristics of each video frame 
(e.g., picture): spatial activity, temporal activity, image size, 
frame rate, scene change, brightness, flash, fade, and hori- 
zontal pixel resolution. The system should bias the bit rate 55 
allocation according to inter- frame distance, whether the 
average spatial activity level is below a lower threshold, 
whether the inter-frame distance is above an upper threshold 
or below a lower threshold, whether the quantization of 
previous frames is above an upper threshold, the length of 60 
the Group of Pictures (GOP), and a user-selectable priority 
factor. 

The system should also allocate any surplus bit rate, if 
any, among the channels, to avoid having unused bandwidth. 

The system should be compatible with progressive or 65 
interlaced video, as well as different image shapes and sizes, 
including Video Object Planes (VOPs). 
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The system should further be compatible with different 
video standards including NTSC, PAL, and NTSC detele- 
cine. 

The system should provide a pre-processor which can be 
used with existing commercially available compression cir- 
cuitry to allow quick and inexpensive retrofitting of such 
circuitry. 

The present invention provides a system having the above 
and other advantages. 

SUMMARY OF THE INVENTION 

The present invention relates to a method and apparatus 
for bit rate allocation in a multi-channel video data encoder. 

A method for allocating a bit rate to a plurality of variable 
rate video channels in a video encoder includes the steps of: 
processing video data from a current picture (e.g., frame) in 
each respective channel to determine at least a spatial 
activity and a temporal activity thereof; and determining a 
bit rate demand D f for each current picture according to the 
associated spatial activity and temporal activity. 

The method is suitable for use with multiplexed channels 
that are all variable rate, as well as with a combination of 
fixed rate and variable rate channels. 

The method may include the further step of adjusting the 
bit rate demand for each current picture according to 
whether at least one of a scene change, fade and flash is 
detected for the current picture. Generally, bit allocation is 
increased if any of these events are detected since such 
events cannot usually be efficiently coded. 

The method may include the further steps of increasing 
the associated temporal activity of each current picture if the 
associated spatial activity is below a lower threshold; and 
adjusting the bit rate demand D ( - for each current picture 
according to the increasing step. This is done since motion 
within a 'scene with a low spatial activity will produce an 
artificially small inter-frame difference. 

The method may include the further steps of increasing 
the bit rate demand D,- for each current picture when the 
associated temporal activity exceeds an upper threshold; 
and/or decreasing the bit rate demand D, for each current 
picture when the associated temporal activity is less than a 
lower threshold. This is done since high motion scenes 
require additional bits to maintain a given image quality 
while fewer bits are required for tow motion scenes. 

The method may include the further steps of determining 
a quantization level of at least one previous picture for each 
current picture; and increasing the bit rate demand D, for 
each current picture when the quantization level of the at 
least one previous picture exceeds an upper threshold. This 
is done to avoid oscillations in the quantization level that 
may be noticeable to a viewer. 

Each current picture may be part of an associated Group 
Of Pictures (GOP), where each GOP typically includes one 
or more intra-coded pictures and several inter-coded pic- 
tures. In this case, the method may include the further steps 
of decreasing the bit rate demand D ( - for each current picture 
when a length of the associated group of pictures exceeds a 
nominal level; and/or increasing the bit rate demand D, for 
each current picture when a length of the associated group 
of pictures is less than a nominal level. This is done since 
fewer bits are required to code a large GOP since there are 
relatively more inter-coded (e.g., predictive coded pictures), 
such as B- and P-pictures. 

The method may include the further step of reducing or 
eliminating the increase or decrease of the increasing and 
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decreasing steps, respectively, when the temporal activity of DETAILED DESCRIPTION OF THE 

each current picture exceeds an upper threshold. This is done INVENTION 

since high motion is likely to result in relatively more ^ presem invention relates t0 a method and apparatus 

intra-coded pictures in a GOP. for bit rate a u ocat j on j n a multi-channel video data encoder. 

The method may include the further step of adjusting the 5 RG x iUustrates a ^iti-channel video encoder in accor- 

bit rate demand D, for each current picture according to a dance ^ ^ presenl invention. A multi-channel video 

horizontal pixel resolution thereof. This is done since more encoder shown generally at 100 includes a number N of 

bits are required to code a higher resolution picture. chanQel encoders 1Uj 121, , and 131. Each channel 

The method may include the further steps of determining encoder, also referred to as an application, includes a pre- 

a brightness level for each current picture; and increasing the 10 processor and a compressor. These components need not be 

bit rate demand D f for each current picture when the physically separate but may be implemented in shared 

associated brightness level is less than a lower threshold. hardware, firmware and/or software. However, in a particu- 

Darker scenes should be coded with additional bits to larly advantageous embodiment of the present invention, the 

maintain a perceived image quality. pre-processor circuitry is used with existing commercially 

The method may include the further step of adjusting the 15 available video compression circuitry to allow quick and 

bit rate demand D ( for each current picture according to easy retrofit of an existing channel encoder, 

priority factor thereof that indicates a relative importance of ^ first channel encoder 111 includes a pre-processor 110 

each current picture in the multiplexed data stream. Thus, and a compressor 140, while a second channel encoder 121 

more important channels, such as movies and pay per view includes a pre-processor 120 and a compressor 150, and an 

events, for example, may be allocated additional bits to 20 Nm channel encoder 131 includes a pre-processor 130 and 

provide an enhanced picture. a compressor 160. Each compressor may be implemented 

Moreover, the allocated bit rate for each current picture using a commercially available video processor, such as 

used in the encoding step may be determined in a single those available from C-Cube Microsystems, Milpitas, Calif., 

iteration or in successive iterations, USA. 

The method may comprise the further steps of determin- Each compressor performs conventional compression and 

ing an overall available bit rate for transmitting the current encoding steps such as motion compensation and estimation, 

pictures in a multiplexed data stream; determining an alio- transform coding (e.g., using the Discrete Cosine 

cated bit rate for each current picture according to a ratio of Transform), and Huffman encoding. Pixel data from a first, 

bit rate demand of each current picture and a sum of the bit 3Q second and Nth channel are provided to pre-processors 110, 

rate demands from each current picture; and providing the 120 and 130, respectively. Each pre-processor may operate 

allocated bit rate for each current picture to respective video m parallel, and performs calculations using the respective 

data compressors for compressing the respective current p j xe l data to determine a bit rate demand D ( for each ith 

pictures to obtain compressed video data for transmission in channel. A corresponding bit rate demand signal is provided 

said multiplexed data stream. 35 from each pre-processor to a central control 170. For 

When the allocated bit rate for each current picture is example, pre-processor 110 may communicate with the 

determined in a plurality of iterations including an initial central control 170 via line 114, while pre-processor 120 

iteration and at least one successive iteration, the method communicates with the central control 170 via line 124, and 

may include the further steps of determining a bit rate pre-processor 130 communicates with the central control 

surplus or deficit between the overall available bit rate and 40 170 via line 134. The central control 170 may be imple- 

a sum of the allocated bit rates for each current picture in the mented as a micro-processor using known circuitry, 

initial iteration; and allocating the surplus or deficit among Moreover, each pre-processor 110, 120, 130 may commu- 

at least some of the current pictures according to a ratio of nicate with the central control 170 via a bus in a time-sharing 

bit rate demand of the at least some of the current pictures manner. Each pre-processor may also communicate with the 

and a sum of the bit rate demands of the at least some of the 45 respective compressor. 

current pictures in the at least one successive iteration. A The central control 170 processes the bit rate demand 

satisfactory final bit rate can be converged on usually in signals D, to determine an allocated bit rate R, for each ith 

about three total iterations. channel as explained in greater detail in FIG. 5 below. The 

A corresponding apparatus is also presented. respective allocated bit rate signals R,, where i-1, 2, . . . N, 

BRIEF DESCRIPTION OF THE DRAWINGS 50 are provided to the compressor 140, compressor 150, and 

compressor 160 via lines 144, 154, and 164, respectively. 

FIG. 1 illustrates a multi-channel video encoder in accor- £ach compressor also receives the pixel data from its 

dance with the present invention. respective channel. For example, compressor 140 receives 

FIG. 2 illustrates conceptually how bit rate demand is the channel "1" pixel data via line 112, while compressor 

determined for a video channel in accordance with the 55 150 receives the channel "2" pixel data via line 122, and 

present invention. compressor 160 receives the channel N pixel data via line 

FIG. 3A is Part A of a flowchart illustrating how bit rate 132. 

demand D, is determined in accordance with the present £ ac h compressor compresses and encodes the respective 

invention. pixel data according to the allocated bit rate R (> which is 

FIG. 3B is Part B of the flowchart of FIG. 3 A illustrating 60 provided as a feedforward signal from the pre-processor to 

how bit rate demand D,- is determined in accordance with the the respective compressor. Once the control 170 receives the 

present invention. D,- values from the pre-processors, the control calculates a 

FIGS. 4, 4Aand 4B illustrate how macroblock activity is final K { in one or more iterations, and provides the final R, 

calculated in accordance with the present invention. value to the compressors, 

FIG. 5 is a flowchart illustrating how allocated bit rate R, 65 The pixel data which is compressed and encoded at the 

is determined for several channels of a multi-channel video respective compressors at the allocated bit rate is then 

encoder. provided to a multiplexer (MUX 180) to provide a time 
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multiplexed data stream (e.g., transport stream) on line 182. invention. FIGS. 3A and 3B illustrate an exemplary process 

Specifically, the MUX 180 receives compressed pixel data that is used by the p re-processors in determining a bit rate 

from compressor 140 via line 142, from compressor 150 via demand D, for the respective video channel. It will be 

line 152, and from compressor 160 via line 162. The MUX appreciated that the different steps may be performed in 

180 also receives a control signal from the central control S different sequences, that not every step is required, and that 

170 via line 172 for synchronizing the multiplexing of the additional steps which are not shown may be performed. At 

video data from the respective channels. The MUX 180 and block 302 > average spatial activity SA is calculated for 

control 170 need not be physically separate but may be *e cunent frame. Tlie calculaUon ofSA b discussed 

implemented in shared hardware, firmware and/or software. ^ r * er * ^nection with FIGS. 4 4A and 4B below. In 

F ' t ... block 304, the average spatial activity is optionally mapped 

FIG. 2 illustrates conceptually how bit rate demand is 10 to a mofe range> At block 306 , SA^ is clipped 

determined for a video channel in accordance with the to remove especially high or low values. The actual values 

present invention. The bit rate demand D, from the ith used f or dipping can be determined-by experimentation. At 

channel is an indication of the complexity of the video block 308, the initial bit rate demand for the ith channel, D ( ., 

source being compressed. Note that the terms "bit demand" is set to the average spatial activity value, 

and "bit rate demand" may be used interchangeably, as the 15 At blocJc 3^ me m ter-frame distance INTER^ f is cal- 

bit rate demand is simply the bit demand in a specific time culated as the sum of the absolute differences of the lumi- 

interval. Al block 210, the spatial activity of a current video nance pixel values between the current and previous frames, 

frame is calculated. The spatial activity, or intra-frame INTER Jir , is a measure of temporal activity for the current 

activity, is an average macroblock activity for the frame as frame. At block 312, a scene change, fade, and flash detec- 

discussed in greater detail below in FIGS. 4, 4A and 4B. 20 tion is made. At block 314, the bit rate demand D t - is adjusted 

Note that the term "frame" or "picture" as used herein based on wncthcr a fade * detected. Specifically, if a fade is 

refers generally to any image, including a particular field of detected, D, may be increased by a predetermined amount 

interlaced video, a progressive mode frame, or even a Video can f bc f f b * cxpenmentaUon. D, b increased since 

^u- . r»i /w^r»\ u- u • • • n f coding of fades is generally inefficient. That is, additional 

Object Place (VOP) which is an image in a sequence of £ ^ ^ maint l a ^ veQ video ^ leveL 

generally arbitrarily-shaped images. VOPs are discussed m simiUrlyf * 5lock 316> D/ fe adjusted based on whether a 

the MPEG-4 standard. flash ^ d e tec t e d for the current frame. If a flash is detected, 

At block 220, a temporal or inter-frame activity of the D . ^ increased by a predetermined amount that can be 

current video frame is calculated. At block 230, the scene determined by experimentation. 

change, fade, and flash detection is made. At block 240, the ^ At block 318, if SA avg is less than a lower threshold, 
average quantization step size for the current video frame is INTER dist is increased. This is done since motion within a 
determined. The scene change, fade, and flash detect block scenc a i ow spatial activity will produce an artificially 
230 receives data inputs from the temporal activity block smal i inter-frame distance. At block 320, if INTER^, is 
220 and quantization step size block 240. At block 250, the above an upper threshold which can be determined by 
brightness of the current frame is determined, while at block ^ experimentation; D,- is increased. This is done since the 
260, the frame rate is determined, and at block 270, the inventors have determined that very high levels of inter- 
current image size is determined. Information from each of f rame activity are relatively more noticeable and therefore 
the blocks 210, 220, 230, 240, 250, 260 and 270 is then require additional bits to maintain a given image quality 
provided to the bit rate demand block 280 to determine D,. \ tvt \ t Conversely, as block 322, if INTER^, is below a 
At block 220, the temporal activity of the current frame is 4Q lower threshold which can be determined by 
determined as the sum of the absolute pixel differences experimentation, D ( . is decreased since scenes with little 
between the current and previous frames. Each pixel differ- motion are encoded more efficiently, so fewer bits can be 
ence is determined for correspondingly situated pixels used for coding. 

within the respective frames. Referring to block 240, the At block 324, if the previous quantization level, 

quantization step size is the result of compressing a prior 45 QTJANT prtfWottJ , is greater than an upper threshold, which 

picture at a previously-determined bit rate. At block 230, the can DC determined by experimentation, D, is increased. This 

scene change, fade, and flash detect may be performed using ^ do ne to avoid oscillations in the quantization level that 

any known technique. For example, a fade may be detected mav be noticeable to the viewer. Additionally, note that since 

if the average picture brightness is decreasing over a number the quantization level may vary with the picture type, the 

of frames. Moreover, a flash may be detected when the $Q quantization level should be taken only from similar picture 

picture brightness increases rapidly above an upper thresh- types, e.g., from B-pictures or P-pictures. Moreover, the 

old. quantization level can be run through a fast attack, slow 

At block 250, the brightness is determined as the average decay function to avoid fluctuations in the bit rate. Such a 

pixel luminance in the current frame. At block 260, the function can be implemented in a filter that allows a rapid 

frame rate is determined according to the interval between 5S increase in the quantization level but only a slow decrease, 

the current and previous frames. The frame rate may vary, Thus, QUANT^^ may represent a value that is a func- 

for example, between standard NTSC video, with thirty tion of the actual quantization level of one or more previous 

frames per second, PAL video at twenty-five frames per frames. 

second, and NTSC detele cine video a tan average of twenty- Next, at block 326, the length of the GOP is used to 

four frames per second. 60 modify the bit rate demand D f Note that according to the 

At block 255, a length of the group of pictures (GOP) is MPEG-2 or similar video standards, a group of pictures 

also provided as an input for determining the bit rate demand includes at least one I-picture, which is intra coded without 

D,. At block 270, the image size of the current frame is reference to any other picture, followed by a number of 

determined based on the horizontal resolution, or number of inter-coded or predicted pictures such as B-pictures and 

pixels per line. 65 P-pictures. 

FIG. 3A is Part A of a flowchart illustrating how bit rate A B-picture is a bi-directionally predicted picture which 

demand D, is determined in accordance with the present uses both previous and future pictures (in presentation order) 
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for prediction. A P-picture uses only a previous picture for At block 344, the final bit rate demand D, is now available 

prediction. Therefore, with successive GOPs, each having for use by the central control 170 in allocating the bit rate R,. 

one I -picture, a frequency of I pictures in the data stream can for each ith channel as set forth in FIG. 5 and the accom- 

be determined. Therefore, at block 326, if the nominal GOP panying discussion below. 

is more than fifteen pictures in length, D, should be 5 FIGS. 4, 4A and 4B illustrate how macroblock activity is 

decreased. This accounts for the relationship between the calculated in accordance with the present invention. As each 

required bit rale and the frequency of I-pictures. picture in encoded, an activity value is generated for each 

r, -. ii • 1 macroblock in the current picture. Each 16x16 luma value 

That is, the frequency of I-pictures ts generally inversely macrob]ock ^ subdivided mt0 2x2 ^ and me values in 

proportional to the length of the GOPs Moreover, for a eacfa ^ afe examined In each mt the absolute difference 

given picture quality, fewer bits are needed to code pictures 10 ^ ^ betweeQ Qne comer (eimer lhe top right 0f 

in a larger GOP since there are relatively more inter-coded bottom left ) and its horizontal and vertical neighbors is 

pictures, and inter-coded pictures (B-pictures and taken. For example, in FIG. 4 a macroblock shown generally 

P-pictures) require fewer bits to code than I-pictures. at 400 includes tiles 410 and 420. Tile 410 includes pixel "a" 

Conversely, more bits are needed to code pictures in a 412, pixel "b w 414, pixel "c" 416 and pixel "d" 418. The tile 

smaller GOP since there are relatively fewer inter-coded 1 5 activity is the absolute value of b-a plus the absolute value 

pictures. of b-d. Tile 420 includes a pixel "a" 422, pixel "b" 424, pixel 

The nominal GOP length for adjusting the bit rate need V 426, and pixel "d" 428. The tile activity is the absolute 

not be fifteen pictures, but this value has been determined by value of c-a plus the absolute value of c-d. 

the inventors to be satisfactory. It is possible to use higher The absolute difference terms for each tile are summed to 

and/or lower GOP length thresholds. 20 give the macroblock activity. The macroblock activity val- 

FIG. 3B is Part B of the flowchart of FIG. 3 A illustrating ues are then summed across the entire current picture and 

how bit rate demand D, is determined in accordance with the divided by the total number of macroblocks in the picture to 

present invention. At block 328, if the length of the GOP is obtain the picture's average spatial activity. The average 

less than fifteen pictures, an increase is set for D ( , At block 25 spatial activity may then be reported to the pre-processor. 

330, the magnitude of the increase or decrease of D, based Of course, the activity calculation procedure shown may 

on the length of the GOP is reduced if the inter-frame be modified in various ways. For example, the tile size may 

distance INTER^, is greater than an upper threshold which be varied along with the selected reference pixel in each tile, 

can be determined by experimentation. That is, the magni- FIG. 5 is a flow chart illustrating how allocated bit rate R ( 

rude of the adjustment is reduced when the inter-frame 3Q is determined for several channels of a multi-channel video 

activity is high since a large amount of motion is likely to encoder. Once the bit rate demand D, has been determined 

cause intra-coding in all pictures, thereby countering the by the pre-processors for each video channel as explained in 

effect of the I-frame frequency. The decrease of block 326 connection with FIGS. 3 A and 3B, it is forwarded to the 

and the increase of block 328 may even be eliminated for central control 170, as shown in FIG. 1. The central control 

very high levels of inter-frame activity. At block 332, D ( - is 35 170 use s the demand signals D ( to determine corresponding 

modified by the adjusted increase or decrease, if any. allocated bit rate signals R, for each ith channel. Generally, 

At block 334, D, is adjusted based on the horizontal one or more iterations may be used by the control to arrive 

resolution of the current frame. Specifically, D, is increased at a final R,. That is, an initial R, may be fine tuned in 

if the horizontal resolution is greater than a baseline level, successive iterations. 

and D, is decreased if the resolution is less than the baseline 40 Referring to FIG. 5, at box 500, the central control solicits 

level. For example, if the baseline level corresponds to the applications to obtain the bit rate demands D„ e.g., every 

standard NTSC video, additional bits will be allocated for ten msec. The term "application" is used generally to refer 

High Definition Television (HDTV). At block 336, if the to each channel encoder, which comprises the combination 

brightness is less than a threshold that can be determined by of a pre-processor and compressor for each channel. At box 

experimentation, D ( - is increased. The bit rate is increased for 45 505, if an application does not respond to the control's 

relatively dark scenes, since such scenes generally are not request within a predetermined amount of time, for example, 

coded efficiently. At block 338, if a scene change is detected, eighty msec, the control marks that application as "dead" or 

D f is set to a maximum value. This is done since scene "inactive" and sets Dg to a minimum value. An application 

changes generally are also not coded efficiently, even more may or may not respond to a solicitation based on whether 

so than dark scenes. 50 it has computed new need information. That is, the appli- 

At block 340, D, is clipped between maximum and cation need not respond to a solicitation if it has not 

minimum values and linearly scaled to a predetermined computed a new need value, D,. The control retains the most 

range, e.g. 50 to 700. recent need value from each application. The application 

At block 342, the allocated bit rate D ; is optionally further remains in a minimum rate status until it responds to a 

adjusted by a priority factor according to the relative impor- 55 subsequent control solicitation in which case the application 

tance of the video channel. Assuming a base line priority * marked as alive and is allocated the currently determined 

factor of "1", for example, a relatively more important video ratc 

channel will have a priority factor greater than "1", while a Each time the updated bit rate needs D,. have been 

relatively less important video channel will have a priority received from at least one-half of the alive VBR 

factor less than "1". For example, it may be desirable to 60 applications, for example, the control executes the bit allo- 

assign a relatively high priority factor to movies and special cation procedure. Upon completion of the procedure, R,. is 

sporting events, while a relatively low priority factor is sent to each application even if the application's new rate is 

assigned to common news broadcasts. The priority factor lhe same as the old rate. The control and MUX implement 

may be specified by an operator using a keyboard or other the transport stream schedule according to the specified 

input device that communicates with the central control 170 65 fixed rales, if any, and the calculated variable rates, 

of FIG. 1. Also at block 342, D ( - is normalized, for example, At box 510, the sum of the bit rate requests from the dead 

by dividing by 128. applications is subtracted from an available bit rate. The 
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available bit rate may be a fixed amount that is known a 
priori or may vary with time. The available bit rate is the 
overall amount of channel bandwidth that is currently allo- 
cated for transmitting the data from each VBR video chan- 
nel. This available bit rate may correspond to a transport bit 5 
rate minus the fixed rate allocations for any fixed rate 
channels that are multiplexed with the VBR channels. At 
block 515, the remaining bit rate is allocated to the alive or 
active applications in proportion to their need values. At 
block 520, each allocated rate is examined to see if it 10 
exceeds the application's specified minimum or maximum 
rate. If so, the allocated rate is clipped to the appropriate 
minimum of maximum limit. 

At block 525, any surplus and deficit bit rate from each 
channel is collected (e.g., summed) to form a net surplus or 15 
net deficit bit rate. A net surplus occurs when the available 
bit rate is greater than the sum of the allocated bit rates, 
while a net deficit occurs when the opposite is true, Note that 
a surplus for one channel can offset a deficit for another 
channel. At block 530, if a net surplus is present, any 20 
application at its maximum rate is eliminated from further 
adjustments until the next iteration of the process, if any. 
Similarly, at block 545, if a net bit rate deficit is present, any 
application at its minimum rate is eliminated from further 
adjustments until the next iteration of the process, if any. 25 

At block 535, the net surplus bit rate is reallocated among 
the remaining applications in proportion to their need val- 
ues. Similarly, at block 550, the net deficit is reallocated 
among the remaining applications in proportion to their need 
values. At block 555, if there is no net surplus or net deficit 30 
present, the allocated bit rate R, is communicated from the 
central control 170 to each compressor. The video data is 
compressed and encoded according to the final value of R, 
and communicated to the MUX 180. ^ 

At block 540, the reallocation of the net surplus or net 
deficit may be repeated in successive reiterations if a net 
surplus or net deficit is still present and the bit rate has not 
been fixed at a minimum or maximum value for all appli- 
cations. The process may be repeated at block 525 for an 4Q 
additional two iterations, for example. Limiting the process 
to a maximum of three iterations is done to limit computa- 
tion time. However, it should be appreciated that the present 
invention may also be implemented with one or more 
iterations. 45 

If a net surplus or net deficit exists after the third iteration, 
it is distributed equally among all applications that remain 
available for adjustment; that is, the applications that are not 
dead or fixed. At block 560, the final allocated bit rate R, is 
communicated to the compressors for each ith channel. 50 

An operator may control the bandwidth allocated to each 
application via bit-rate setting. Any application can be set to 
a fixed bit rate. A video encoder can alternatively be set to 
a variable bit rate (VBR) through the specification of a 
minimum and maximum bit rate. The minimum transport bit 55 
rate required for a multi-channel video encoder is equal to 
the sum of the fixed bit rates plus the sum of the minimum 
VBR rates, that is: 

MLninumNecessaryBitrate-CTixedRate+IVBRMinRates. 6Q 

Similarly, the maximum usable bandwidth is the sum of the 
fixed bit rates plus the sum of the maximum VBR rates: 

MaximumUseableBitrate-ZFixcdRate+ZVBRMftxRatea. 

65 

If the available transport bit rate is less than the mmimum 
required bit rate, the system cannot comply with the speci- 
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fled configuration. If the available transport bit rate is greater 
than the maximum useable bit rate, then all VBR applica- 
tions run at their respective maximum rates, and no statis- 
tical multiplexing will occur. If the available transport rate 
is between the minimum and maximum bit rates, statistical 
multiplexing occurs, and the entire available transport band- 
width is allocated among the different channels. 

Prior to encoding each picture, each VBR channel 
encoder checks for a new allocated bit rate, R„ from the 
control. If there is a new rate, the channel encoder is 
commanded to compress and encode the channel data at the 
new rate. 

Regarding timing of the rate control scheme, as discussed, 
a frame activity value is calculated in the respective channel 
encoders and made available to the control at the frame rate. 
For standard NTSC encoding, the update interval is every 33 
msec, while for PAL it is every 40 msec, and for NTSC 
with detelecine, the time between updates is 33 msec and 50 
msec. 

Preferably, the control executes its bit allocation process 
each time it has updates from at least one-half of the VBR 
applications. This should occur no less frequently than every 
fifty msec 

As can be seen, the present invention provides a system 
for allocating a bit rate to a plurality of variable rate channels 
in a video encoder according to the bit rate demand from 
each channel and the available bit rate. Advantageously, a bit 
rate demand D, is determined in a pre-processor for each 
channel prior to compressing and encoding the data for 
transmission. The allocated bit rate R, may be determined 
from the D t - values in one or more iterations. 

The bit rate demand D ( - accounts for various characteris- 
tics of the current picture data in each channel, including 
spatial activity, temporal activity, image size, frame rate, 
scene change, brightness, flash, fade, and horizontal pixel 
resolution. The system also biases the bit rate allocation 
according to inter- frame distance, whether the average spa- 
tial activity level is below a lower threshold, whether the 
inter-frame distance is above an upper threshold or below a 
lower threshold, whether the quantization of previous 
frames is above an upper threshold, the length of the Group 
of Pictures (GOP), and a user-selectable priority factor. The 
system also allocates any surplus bit rate among the chan- 
nels to avoid having unused bandwidth. 

Although the invention has been described in connection 
with various specific embodiments, those skilled in the art 
will appreciate that numerous adaptations and modifications 
may be made thereto without departing from the spirit and 
scope of the invention as set forth in the claims. 
What is claimed is: 

1. A method for determining a bit rate need of a plurality 
of variable rate video channels in a video encoder, compris- 
ing the steps of: 
processing video data from a current picture in each 
respective channel to determine at least a spatial activ- 
ity and a temporal activity thereof; 
determining a bit rate demand for each current picture 
according to the associated spatial activity and tempo- 
ral activity; 

determining an overall available bit rate for transmitting 

the current pictures in a multiplexed data stream; 
determining, in an initial iteration, an initial allocated bit 
rate for each current picture according to a ratio of bit 
rate demand thereof to a sum of the bit rate demands 
from each current picture; 
determining a bit rate surplus or deficit between the 
overall available bit rate and a sum of the initial 
allocated bit rates; and 
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adjusting, in at least one successive iteration, the initial 
allocated bit rate for at least some of the current 
pictures according to the surplus or deficit, and a ratio 
of bit rate demand thereof to a sum of the bit rate 
demands thereof. 5 

2. The method of claim 1, wherein: 

current pictures that have new bit rate demands have their 
initial allocated bit rates adjusted in said adjusting step. 

3. The method of claim 1, wherein: 

current pictures that have unchanged bit rate demands do 10 
not have their initial allocated bit rates adjusted in said 
adjusting step. 

4. The method of claim 1, comprising the further step of: 
providing the allocated bit rate for each current picture to ]5 

respective video data compressors for compressing the 
respective current pictures to obtain compressed video 
data for transmission in said multiplexed data stream. 

5. An apparatus for determining a bit rate need of a 
plurality of variable rate video channels in a video encoder, 2Q 
comprising: 

means for processing video data from a current picture in 

each respective channel to determine at least a spatial 

activity and a temporal activity thereof; 
means for determining a bit rate demand for each current 25 

picture according to the associated spatial activity and 

temporal activity; 
means for determining an overall available bit rate for 

transmitting the current pictures in a multiplexed data 

stream; 



means for determining, in an initial iteration, an initial 
allocated bit rate for each current picture according to 
a ratio of bit rate demand thereof to a sum of the bit rate 
demands from each current picture; 

determining a bit rate surplus or deficit between the 
overall available bit rate and a sum of the initial 
allocated bit rates; and 

means for adjusting, in at least one successive iteration, 
the initial allocated bit rate for at least some of the 
current pictures according to the surplus or deficit, and 
a ratio of bit rate demand thereof to a sum of the bit rate 
demands thereof. 

6. The apparatus of claim 5, wherein: 

current pictures that have new bit rate demands have their 
initial allocated bit rates adjusted by said adjusting 
means. 

7. The apparatus of claim 5, wherein: 

current pictures that have unchanged bit rate demands do 
not have their initial allocated bit rates adjusted by said 
adjusting means. 

8. The apparatus of claim 6, further comprising: 
means for providing the allocated bit rate for each current 

picture to respective video data compressors for com- 
pressing the respective current pictures to obtain com- 
pressed video data for transmission in said multiplexed 
data stream. 
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